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Abstract 

Hidden variables are extra components added to try to banisii counterintuitive features of 

quantum mechanics. We start with a quantum-mechanical model and describe various properties 

I I that can be asked of a hidden- variable model. We present six such properties and a Venn diagram 

(-«) ^ of how they are related. With two existence theorems and three no-go theorems (EPR, Bell, and 

•j Kochen-Specker), we show which properties of empirically equivalent hidden- variable models are 

C possible and which are not. Formally, our treatment relies only on classical probability models, 

r-{ and physical phenomena are used only to motivate which models to choose. 

^^ 1 Introduction 

> 

^^ Begun by von Neumann [35l 1932], the hidden- variable program in quantum mechanics (QM) adds 

vQ extra ("hidden") ingredients in order to try to banish some of the counterintuitive features of QM. 

■^ These features are: (i) the probabilistic nature of quantum behavior, (ii) the possibility of so-called 

'"H non-local effects between widely separated particles, and (iii) the idea of an intrinsic dependence 

f.^^ between the observer of a QM system and the properties of the system itself. 

^D Hidden-variable theories aim to remove these strange aspects of QM by building more "com- 

>■ plete" models (in the terminology of Einstein-Podolsky- Rosen [Tni 1935]). The completed models 

K^ should agree with the predictions of QM, but exhibit one or more of the desired properties of: (i) 

^ determinism, (ii) locality, and (iii) independence. 

Can such models actually be built? The famous "no-go" theorems of QM show that there are 
severe limitations to what can be done. But it is also true that certain combinations of properties 
are possible. 
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Our modest goal in this paper is to provide a formal framework in which various properties one 
might ask of hidden-variable models can be stated and in which various non-existence and existence 
results can be organized. Almost all-if not all-of the ingredients of what we do in this paper are 
well known to researchers in the area. Our contribution, we hope, is in putting all the ingredients 
into one simple setting. 

The setting is classical probability spaces. The question is, given a classical probability model, 
whether there exists an associated hidden-variable model that is empirically equivalent to the first 
model and that satisfies certain properties. These properties are motivated by the literature on 
hidden variables in QM. The specific properties we consider-and the relationships among them-can 
be depicted in the Venn diagram of Figure 1.1. (We define all the terms later.) The diagram contains 
21 regions. 
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The main result of the paper is that we can give a complete account of these 21 regions. For 10 
of these regions (indicated with checks), it is always possible to find an equivalent hidden- variable 
model with the properties in question. For the remaining 11 regions (indicated with crosses), this 
may not be possible. We fill in the regions via two existence results and three non-existence results. 
The latter three are the famous theorems of Einstein-Podolsky-Rosen (EPR) [TBI 1935] F] Bell [2j 

^Strictly speaking, EPR did not state a non-existence theorem, but it is useful to present their argument this way. 



1964], and Kochen-Specker O 1967]. 

It is important to understand that, formally, our paper makes no use of physical phenomena. 
It is an exercise in classical probability theory alone. Of course, the probability spaces we select 
for the non-existence results are inspired by the physical experiments described in EPR, Bell, and 
Kocher-Specker. But we hope it is conceptually clarifying to present the hidden-variable question 
in a purely abstract setting-that is, to show how much follows from the rules of probability theory 
alone. 

Naturally, our account of hidden-variable theory is complete only relative to the properties we 
consider (there are six of them). These properties are, as far as we can tell, the main ones considered 
in the literature. (As we explain later, we have added one definition.) In particular. Bell Locality ([2J 
1964]) is equivalent to the conjunction of Outcome and Parameter Independence (Jarrett [53J 1984], 
stated here as Proposition 2.1). Kochen-Specker [24l 1967] Non-Contextuality is implied by the 
conjunction of Parameter Independence and A-Independence (Proposition 2.2). But there may well 
be other interesting properties to put on hidden- variable models, which would lead to an extension 
of Figure 1.1. 

There are, of course, many treatments of the hidden-variable question. (Prominent examples 
include Belinfante [D 1973], Gudder [HI 1988], Mermin [371 1993], Peres [23 1990], and van Fraassen 
[341 1991].) This paper is not meant to be a comprehensive survey. Our goal is, in a sense, the 
reverse. It is to start with the rules of probability theory alone and ask-relative to the six properties 
we consider-what is or is not possible. For this task, we need only EPR, Bell, and Kochen-Specker. 
But we do mention later some other no-go results in QM (not needed to complete Figure 1.1). 

Two comments on the particular framework we present. First, we work with a single probabil- 
ity measure on a single space, where points in the space describe measurements on particles and 
outcomes of those measurements. An alternative-more conventional-approach would be to use a 
family of probability measures on a space describing outcomes only, with different probability mea- 
sures corresponding to different measurementsP] In fact, all our requirements are stated in terms of 
conditional probabilities: If such-and-such a measurement is made, then what is the probability of a 
certain outcome? The distinction between the approaches might therefore seem small-both involve 
families of probability measures. But it matters. If we had started from a family of probability 
measures rather than a single measure, we would not have been able to derive all the relationships 
between properties shown in Figure 1.1 without making some additional assumptionsjj So, formally, 
our approach is more parsimonious. Yet, it does add an ingredient at the conceptual level- viz., the 
existence of a probability measure prior to conditioning on measurements. This measure may be 
thought of as representing the perspective of a super-observer who observes the experimenters as 
well as the outcomes of the experiments. Does the existence of such a measure contradict the free 
will of an experimenter in deciding what measurements to make? We don't think so-because, as we 



^We are grateful to Shelly Goldstein and a referee who both pointed to this issue. 

^A reader preferring the more conventional approach can simply make those additional assumptions. We give 
details in the next section. 



said, we work only with the conditionals. Still, even if it plays a very small role in our treatment, 
the idea of such a measure seems deserving of further study. We leave this as beyond the scope of 
the current paper. 

A second choice we make in our framework is to treat only finite probability spaces. This involves 
a tradeoff. On the one hand, finiteness allows us to avoid all measure-theoretic issues. On the other 
hand, as an assumption on the space in which a hidden variable lives, finiteness is undoubtedly 
restrictive. To be precise, the first of our two existence theorems needs only a finite space in any 
case, but, under finiteness, the second can treat only rational probabilities. (We sketch the extension 
of our second theorem, using an infinite space, to all probabilities.) Of course, finiteness makes our 
versions of the no-go theorems weaker. 

We derive Figure 1.1 in the body of the paper. Before that, though, let us offer a comment 
on its conceptual meaning in QM. The main message of the no-go theorems is that in building a 
hidden- variable theory, some properties that might be viewed as desirable-at least, a priori-have to 
be given up. But there is a choice of what to give up. Arguably, it is more a matter of metaphysics 
than physics as to what choice to make. The point of a formal treatment-as in Figure 1.1-is to give 
a precise statement of what the options are. There is a basic three-way tradeoff. We can have: 

(i) Determinism (As we will explain, this comes in a strong or a weak form.) This says that 
randomness reflects only observer ignorance. Once hidden variables are introduced, there is 
no residual randomness in the universe. 

(ii) Parameter Independence This says that when conducting an experiment on a system of 
particles, the outcome of a measurement on one of the particles does not depend on what 
measurements are performed on other particles. (The intuitive appeal of this property is that 
often the particles are widely separated.) This is a way of saying that the universe is local. 

(iii) A-Independence This says that the nature of the particles-as determined by the value of 
a hidden variable-does not depend on the experiment conducted. There is, in this sense, no 
dependence between the observer and the observed. 

Any one of these properties is consistent with the predictions of QM. So are certain combinations 
of properties, as Figure 1.1 shows. But, however a priori reasonable they may seem, we cannot have 
all three properties-or even certain pairs of properties. There is an inherent tradeoff. This is an 
inescapable feature of QM. 

The rest of the paper is organized as follows. Section 2 lays out the framework and basic 
definitions. Section 3 presents two existence theorems on hidden-variable models. Sections 4-6 
present EPR [111 1935], Bell [2j 1964], and Kochen-Specker |24l 1967] in our probabiHty-theoretic 
framework. Section 7 mentions some other impossibility results in QM not covered in this paper. 



2 The Models and Their Properties 

Here is the hidden- variable question in a bit more detail. Start with a model of an experiment done 
in QM. Sometimes, the experiment will consist of measurements performed on several entangled 
particles. Or, the experiment might involve several measurements performed on a single particle. 
The model describes the set-up and outcome of the experiment and so will be called an "empirical 
model." The question is whether one can find a hidden- variable model-i.e., a model involving 
additional ( "hidden" ) variables-which is empirically equivalent to the first model and which has 
desired properties. By "empirically equivalent" we mean that the two models make the same 
(probabilistic) prediction about outcomes. 
Formally, we consider a space 

* = {a, a', . . .} X {b, b', . . .} X {c, c', . . .} • • • X {A, A', . . .} x {B, B' , . . .} x {C, C", . . .} x • • • . 

The variables A, B,C, ... are measurements, and the variables a,b,c, ... are associated outcomes 
of measurements. There might be several particles: Ann performs a measurement on her particle. 
Bob performs a measurements on his particle, .... Or, ^ might describe a case where several 
measurements are performed on one particle. The definitions to come apply in either case. We 
take each of the spaces in ^ to be finite, and suppose that ^ is a finite product. 

Let A be a finite space in which a hidden variable A livesjj The overall space is then 

r^ = * X A. 

Definition 2.1 An empirical model is a pair (^,g), where q is a probability measure on ^. A 
hidden- variable model is a pair (fl,p), where p is a probability measure on fl. 

Essentially, we employ the probability measures q and p once conditioned on one or more mea- 
surements. Still, as we said in the Introduction, we cannot quite dispense with the unconditional q 
and p, and work instead with a family of probability measures indexed by measurements (one family 
for q and one for p). If we did, we would lose Lemmas 2.1 and 2.4-and hence certain relationships 
in Figure 1.1. These relationships seem intuitively correct to us, so we prefer a formalism in which 
they can be derived. With an indexed family of measures, we would have to impose rather than 
derive these relationships. 

The models of Definition 2.1 stand alone. However, we are also interested in stating when 
different models are equivalent: 

Definition 2.2 An empirical model (^,9) and a hidden-variable model (ri,p) are (empirically) 



''Throughout, we talk about one hidden variable. But we put no structure on the space in which the hidden 
variable lives. Of course, in the infinite case, a measurable structure would be needed. 



equivalent if for all a,b,c, . . . , A, B,C, . . . , 

q{A, B,C,...)>0 if and only if p{A, B,C,...) > 0, 
and when both are non-zero, 

q{a, b,c,... \A, B,C,...)^ p{a, b,c,... \A, B,C,...). 
Here, we write "a, b,c, . . ." as a shorthand for the event 

{{a,b,c,...)}x{A,A',...}x{B,B\...}x{C,C\...}x--- 
in ^E*, or the event 

{(a, b,c,.. .)} X {A, A', . . .} X {B, B', . . .} x {C, C", . . .} x • • • x A 

in fl, and similarly for other expressions. We will adopt this shorthand throughout. 

The non-nuUness condition is simply to ensure that any measurements (A, B,C, . . .) which are 
possible in the empirical model are also possible in the hidden-variable model under consideration, 
and vice versa. Without this condition, it would be hard to compare the two models. 

We will often calculate p{a, b,c, . . . \A, B,C, . . .), for p{A, B,C, . . .) > 0, from the formula: 

p{a,b,c,...\A,B,C\...)= Y. p{a,b,c,...\A,B,C,...,X)p{X\A,B,C,...). 

{\:p{A,B,C,...,X)>0} 

Substituting this in Definition 2.2, we see that the idea of equivalence is to reproduce a given 
probability measure q on the space ^ by averaging under a probability measure p on an augmented 
space f2, where fl includes a hidden variable. The measure p is then subject to various conditions 
(described below). 

One more basic definition: 

Definition 2.3 Two hidden-variable models (ri,p) and (51, p) are (empirically) equivalent if for 

all a,b,c, . . . , A,B,C, . . . , 

p{A, B,C,...) >0 if and only ifp{A, B,C,...)> 0, 

and when both are non-zero, 

p{a, b,c,... \A, B, C, . . .) = p{a, b,c,... \A, B,C,.. .). 

Now, we move on to the different properties of hidden- variable models. Figure 2.1 repeats 
Figure 1.1 (without the checks and crosses), as a preview of the properties and relationships we will 
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consider. 



Weak Determinism 



Parameter independence 



Outcome Independence 




^.-independence 



Singie-Vaiuedness 



Figure 2.1 



Definition 2.4 A hidden-variable model {^,p) satisfies Single- Valuedness if A is a singleton. 

This condition says that the hidden variable can take on only one value. In effect, this condition 
doesn't allow hidden variables. We include it because EPR will be usefully formulated this way. 

Definition 2.5 A hidden-variable model {il,p) satisfies X-Independence if for all A, A' ,B,B' ,C,C' , 
. . ., \, whenever 

p{A, B,C,...)>0 and p{A' , B' , C, . . .) > 0, 



then 



p{X\A,B,C,...)=p{X\A',B\C\...) 



(This term is from Dickson [TH 2005, p. 140].) The condition says that the process determining 
the value of the hidden variable is independent of which measurements are chosen. 

Remark 2.1 If a hidden-variable model satisfies Single- Valuedness, then it satisfies \- Independence. 

Definition 2.6 A hidden-variable model (ri,p) satisfies Strong Determinism if, for every A,X, 
whenever p{A, A) > 0, there is an a such that p{a\A, A) = 1, and similarly for B, A, b, etc. 



Definition 2.7 A hidden-variable model (ri,p) satisfies Weak Determinism if, for every A, B, C, 
. . . , A, whenever p{A, B,C, . . . , X) > 0, there is a tuple a,b,c, ... such thatp{a, b,c, . . . \A, B,C, . . . , X) 
1. 

Determinism is a basic condition in the literature. But we are careful to make a distinction 
between a strong and weak form. We will see that various results are true for one form but false for 
another. Broadly, the condition is that the hidden variable determines (almost surely) the outcomes 
of measurements. But, Strong Determinism says this holds measurement-by-measurement, while 
Weak Determinism says this holds only once all measurements are specified. There is a one-way 
implication: 

Lemma 2.1 // a hidden-variable model satisfies Strong Determinism, then it satisfies Weak Deter- 
minism. 

Proof. Suppose p{A, B,C, . . . , X) > 0. Then p{A, A) > 0,p{B, A) > 0,p(C, A) > 0, . . . . So, there 
are a,b,c, . . . , such that p{a\A, A) = l,p{b\B,X) — l,p{c\C,X) = 1, . . . . 

The result now follows from the following easy fact in probability theory: Let Ei, . . . ,En and 
Fi, . . . , F„ be events with p{f].^ F,) > 0. If piE,\F,) = 1 for all t, then p{f]^ E,\ f], F,) = 1. ■ 

Definition 2.8 A hidden-variable model (51, p) satisfies Outcome Independence if for all a,b,c, 
. . . , A,B,C,..., X, whenever p{A, B,C, . . . ,b,c, . . . , X) > 0, 

p{a\A, B, C, . . . , 6, c, . . . , A) = pia\A, B, C, . . . , A), (2.1) 

and similarly with a and b interchanged, etc. 

Outcome Independence is taken from Jarrett [23J 1984] and Shimony [STJ 1986]. It says that 
conditional on the value of the hidden variable and the measurements undertaken, the outcome of 
any one measurement is (probabilistically) unaffected by the outcomes of the other measurements. 

Lemma 2.2 A hidden-variable model (0,p) satisfies Outcome Independence if and only if for all 
a,b,c, . . . , A, B , C , . . . , X, whenever p{A, B,C, . . . ,X) > 0, 

p{a, b,c,...\A,B,C,...,X)= p{a\A, B,C,...,X)x p{b\A, B, C, . . . , A) x p{c\A, B, C, . . . , A) x • • • . 

(2.2) 

Proof. Standard; see, e.g., Chung |9l 1974, Theorem 9.2.1]. ■ 

Lemma 2.3 (Bub [7j 1997, p. 69]) If a hidden-variable model satisfies Weak Determinism, then 
it satisfies Outcome Independence. 

Proof. Suppose p{A, B,C, . . . ,X) > 0. Then, by Weak Determinism, there is a tuple a* ,b* ,c* , . . . 
such that 



p{a, b,c,...\A,B,C,...,\) = X{a=a*} x X{b=b'} x X{c=c'} x • • • . 

But then p{a\A,B,C\...,X) = X{a=a'}, p{b\A,B,C, . . . ,X) = X{b=b'}, p{c\A,B,C, . . . ,X) = 
X{c=c*}i ■ ■ ■ ■ Now use Lemma 2.2. ■ 

Definition 2.9 A hidden-variable model (fi, p) satisfies Parameter Independence if for all a, A,B, C , 
. . . , X, whenever p{A, B, C, . . . , A) > 0, 

pia\A,B,C,...,X)^p{a\A,X), (2.3) 

and similarly for b, A, B,C, . . . , X, etc. 

Parameter Independence is also from Jarrett [23l 1984] and Shimony [311 1986]. It says that, 
conditional on the value of the hidden variable, the outcome of any one measurement depends 
(probabilistically) only on that measurement and not on the other measurements. 

Lemma 2.4 // a hidden-variable model satisfies Strong Determinism, then it satisfies Parameter 
Independence. 

Proof. Suppose p{A, B,C, . . . ,X) > 0. Then p{A, X) > 0. So, by Strong Determinism, there 
is an a* such that p{a\A, X) ~ X{a=a*}- But p{a, A, B,C, . . . ,X\A,X) = p{a\A,B,C,...,X) x 
piA, B,C, . . . , X\A, X),wheTep{A, B,C, . . . , X\A, X) > 0. Fromp(a*|^, A) = I, p{a* ,A, B,C, . . . , X\A, X) 
= p{A,B,C,...,X\A,X). From p{a\A, X) = when a ^ a*, we get p{a, A, B,C, . . . , X\A, X) = 0. 
Thus, p{a\A, B,C, . . . ,X) = X{a=a*}i estabhshing (2.3). ■ 

Combinations of some of these properties give the well-known properties of Locality and Non- 
Contextuality. First is Locality, formulated by Bell |5] 1964]. In words, a hidden- variable model 
satisfies Locality if the probability of getting some tuple of outcomes factorizes under the measure- 
ments. 

Definition 2.10 A hidden-variable model (ri,p) satisfies Locality if for all a,b,c, ..., A,B,C, 
,. . . , X, whenever p{A, _B, C, . . . , A) > 0, 

p{a, b,c,...\A,B,C,...,X)= p(a| A, A) x p{b\B, X) x p(c|C, A) x • • • . (2.4) 

Proposition 2.1 (Jarrett j23|, 1984, p. 582]) A hidden-variable model satisfies locality if and 
only if it satisfies Outcome Independence and Parameter Independence. 

Proof. Assume p(A,i?, C, . . . , A) > 0, and substitute (2.3) and its counterparts into (2.2). This 
yields (2.4). 

Conversely, assume again p{A, B,C, . . . ,X) > 0, and sum both sides of (2.4) over b,c, .... This 
yields (2.3). Moreover, substituting (2.3) and its counterparts into (2.4) yields (2.2). ■ 



Non-Contextuality, due to Kochcn-Specker [211 1967], is a property of an empirical model. It 
says that the probability of obtaining a particular outcome of a measurement does not depend on 
the other measurements performed. 

Definition 2.11 An empirical model (^, q) satisfies Non-Contextuality if for all a, A, B, B', C, C , 

. . . , whenever q{A, B,C,. . .) > and q{A, B' , C , . . .) > 0, 

q{a\A,B,C,...)^q{a\A,B',C\...). 

Also, the corresponding conditions must hold for b, A, A' , B, C, C , . . ., etc. 

Proposition 2.2 // a hidden-variable model (f2,p) satisfies \- Independence and Parameter Inde- 
pendence, then any equivalent empirical model {^,q) satisfies Non-Contextuality. 

Proof. We can assume p{A, B,C,...)>0 and p{A, B' , C", . . .) > 0. Then 
p{a\A,B,C,...)^ Y, p{a\A,B,C,...,X)p{X\A,B,C,...) = 

{\:p{A,B,C,...,X)>0} 

J2 p{a\A,B,C,...,X)piX) = 

{X:p{A,B,C,...,X)>0} 

J2 p{a\A,X)p{X), 

{\:p{A,B,C,...,X)>0} 

where the second line uses A- Independence and the third line uses Parameter Independence. Using 
p{A, B,C, . . .) > and A-Independence again, we have p{A, B,C, . . . ,X) > if and only if p{X) > 0. 
So 

p{a\A,B,C,...)= Y. P{a\A,X)p{X). 

{A:p(A)>0} 

A similar argument establishes 

p{a\A,B',C',...)= Y P(a|AAMA), 

{A:p(A)>0} 

so that p{a\A, B,C,. . .) = p{a\A, B' , C , . . .), as required. ■ 

3 Two Existence Theorems 

We next prove two existence theorems for hidden- variable models which say what type of properties 
can always be found: 

El Civen any empirical model, there is an equivalent hidden-variable model which satisfies Strong 
Determinism. 
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E2 Given any empirical model, there is an equivalent hidden-variable model which satisfies Weak 
Determinism and \- Independence. 

That is, each of these sets of conditions on a hidden-variable theory can always be satisfied. 
They cannot be impeded by any no-go theorems. Figure 3.1 repeats part of Figure 1.1, putting a 
check in a region where there is always an equivalent hidden- variable model with the properties that 
hold in that region. The checks are followed by El and/or E2 which say which existence theorem 
pertains to that region. 

(The region for Single- Valuedness alone also has a check. The existence of an equivalent hidden- 
variable model satisfying Single- Valuedness alone is immediate-it is essentially just the given empir- 
ical model. See Remark 3.1 for a statement.) 
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Here are the two existence theorems. Similar methods to those in the first proof can be found 
in Fine [T71 1982, p. 292]. The idea of the second theorem is in Teufel-Berndl-Diirr-Goldstein- 
Zanghi [Ml 1997, p.l219] (see also Werner and Wolf [371 2001, p.7]). But we have not found exact 
statements of the two theorems in the literature. 

Theorem 3.1 Given an empirical model (^,9), there is an equivalent hidden-variable model (ri,p) 
which satisfies Strong Determinism. 
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The proof is basically a mathematical trick. We simply take the hidden variable to be all the 
information possible. This means, in particular, that the hidden variable would have to 'know' 
the probabilities for different measurements and outcomes. With this huge hidden variable, we 
can build up the probability measure p from the given measure q. This construction is physically 
unsatisfying, of course-but not ruled out by the general concept of a hidden variable. It is also rather 
obvious. Bell 1971] wrote: "If no restrictions whatever are imposed on the hidden variables, or 
on the dispersion-free states, it is trivially clear that such schemes can be found to account for any 
experimental results whatever" (reprinted in |H p.33]). Still, we give a proof-which, in particular, 
makes clear that even Strong Determinism is achieved. (This won't be possible in the next existence 
result.) 

Proof. We give the proof for the case that ^P is a 4-way product, but the extension to a general 
(finite) product will be clear. Set 

A = {a, a', . . .} X {h, h', . . .} X {A, A\ . . .} x {B, B' , . . .}, 

and define p in stages, as follows. (Figure 3.2 shows the construction.) For any pair A, B, set 

p{A,B) = q{A,B). (3.1) 

For any pair A, B, and A = (a, b, A, B), set 

, ,, , f q(h,b\A,B) a A = Aand B = B, , , 

piX\A,B)^\ :^ ^ ', . (3.2) 

I otherwise. 

For pairs a, b and A, B, and A = (a, 5, A, B), set 

. ,, , ( 1 iia = a,b=b, A = A, B = B, , , 

pia,b\A,B,X) = \ ^ ^^ .' ' (3.3) 

I otherwise. 

This defines a measure p on fl using 

p{a,b,A,B,\) ^p{a,b\A,B,X) xp{X\A,B) xp{A,B). 

(Note that p{-, -{A, B, A) is not a measure ii A ^ A or B ^ B. But then p{X\A, B) = 0, so there is 
no difficulty.) 

From (3.1), p{A, B) > ii and only if q{A, B) > 0. If both are positive, then from Figure 3.2, 

p{a,b\A,B) = 1 X q{a,b\A,B), 

so that equivalence is satisfied. 
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ia, a', ... > xib, b', ... } 




{A, a; ...y xiB, B'. ...} 



Figure 3.2 



It remains to verify that {^,p) satisfies Strong Deterniinisni. So, suppose p{A, A) > 0. Writing 
A = (a, b, A, B), we therefore assume A = A. Using (3.1)-(3.3), 



p{a,A,X) =p{a,A,X) = ^ p{a,b',A,B',X) = p{a,b,A, B,X) ^q{a,b,A,B) x X{a=d}, 
p(A,A)=p(i,A)= J2 Pia,b',A,B',X)=piii,b,A,B,X)=qCaAAB), 



.b'B' 



SO that 



which is Strong Determinism. 



p{a\A,X) = X{a=a}, 



Corollary 3.1 Given a hidden-variable model (Cl,p), there is an equivalent hidden-variable model 
(rijp) which satisfies Strong Determinism. 

Proof. Start with (fl,p), and (partially) define an equivalent empirical model (^,9) by 
q{a, b\A, B)= J2 P(«' ^1^' ^' ^)P(MA B), 

{\:p(A,B,\)>0} 

for p{A, B) > 0. (There is no difficulty in completing the definition of q.) 

By Theorem 3.1, there is a hidden- variable model (f2,p) which is equivalent to (^P, q) and which 
satisfies Strong Determinism. But {i^,p) is also equivalent to (ri,p). ■ 
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We state the next existence result for the case of rational probabilities, to enable us to prove it 
with a finite set A. After the proof, we sketch the extension to all probabilities. 

Theorem 3.2 Given an empirical model (^,<7) with rational probabilities, there is an equivalent 
hidden-variable model (il,p) which satisfies Weak Determinism and \- Independence. 

The idea of the proof is to have the hidden variable live on the (discretized) unit interval, and 
then to split up the interval according to relevant probabilities. 

Proof. We give a proof for the case that ^E* is a 4-way product, but the argument clearly extends. 
Let p be arbitrary (but with full support) on {A, A', . . .} x {B,B', . . .}. Fix a pair of settings 
(Ai, Bj) with q{Ai, Bj) > 0. For a pair of outcomes (afe, &/), write the conditional probability as 

q{ak,bi\A„Bj) = ^^ 

for some integers rijki > and Sijki > 0. 
Let A have A^ points, where 

i,j,k,l 

We let p be uniform on A^, and then form the product on {A, A' , . . .} x {B, B' , . . .} x A. Thus, 
A-Independence is satisfied. 

Still fixing [Ai,Bj), we 'assign' to (a^jbi) the number of points 

k'^k i'^i k,l 

Formally, we mean that for each of these points, 

p{ak,bi\Ai,Bj,X) = I. 

Thus, Weak Determinism is satisfied. Note that, again for fixed {Ai,Bj), the probability of 
choosing one of these points is 

Tijki X Yik'^k Sijk'i' X Yii'^i rifc.i Si'j'ki 

[[i,j,k,l ^ijkl Sijkl 



and so 



establishing equivalence. 



p{ak,bi\Ai,Bj) = -^^^— ^ q{ak,bi\Ai,Bj), 
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Corollary 3.2 Given a hidden-variable model (f2,p) with rational probabilities, there is an equiva- 
lent hidden-variable model (f2,p) which satisfies Weak Determinism and X-Independence. 

Proof. As for Corollary 3.1, using Theorem 3.2 in place of Theorem 3.1. ■ 

We could handle irrational probabilities in Theorem 3.2, if we allowed an infinite A. Set A = [0,1] 
and again take p to be uniform on A. Fix again a pair of settings {A, B) with q{A, B) > 0. Write 
the support of q{-, -lA, B) as {(ai, 6i), . . . , (a„, 6„)}. Partition A as in Figure 3.3. On element A'' of 
the partition, we set p{ak,bk\A,B,X) = 1. Conceptually, A-Independence and Weak Determinism 
follow as before. (But to make this formal, we would need to extend these definitions to infinite A.) 

1 1 

-Length — ► < — Length- 

q(a^,b^y\,Si ' ' ' q(at,bt\A,B) 

Figure 3.3 

Finally in this section, we record the obvious fact: 

Remark 3.1 Given an empirical model (^>,q), there is an equivalent hidden-variable model {^,p) 
which satisfies Single- Valuedness. 

Proof. Let A — {A}, and, for a, b, A, B, let p{a, b, A, B, A) = q{a, b, A,B). m 

4 EPR 

We have seen that certain types of hidden- variable model are always possible. Next come the no-go 
theorems, expressed in our framework. These show that no other type of hidden-variable model 
(among those covered by our six conditions) is necessarily possible. 

Here is the first no-go theorem, due to EPR [161 1935], expressed in our framework. (Our 
formulation is very similar to that in Norsen f28| 2004].) Figure 4.1 adds crosses to Figure 3.1, in 
accordance with the EPR result. 

Note that, as with our other statements, EPR as given here is a simple result in probability 
theory. But the notation we use in the empirical model is meant to refiect the underlying physical 
set-up which was of interest to EPR. (More precisely, it reflects Bohm's [5, 1951] reformulation of 
EPR.) In the physical set-up, there are two entangled particles that are anti-correlated. If Ann 
measures positive spin, then Bob measures negative spin, and vice versa. There is a 50-50 chance 
of each pair of outcomes. 

Theorem 4.1 (EPR [16i, 1935]) There is an empirical model (^,9) for which there is no equiv- 
alent hidden-variable model (fl,p) which satisfies Single-Valuedness and Outcome Independence. 
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Weak Determinism 



Parameter independence 



Outcome Independence 




LEGEND 
y/ Possible 

jC ImpossibI 

GUARANTEED BY 

El Existence Theorem 1 
E2 Existence Theorem 2 
B Beii 
EPR Einstein-PodoiEl<y-Rosen 
is.jKochen-Specicer 



A.-independence 



Singie-Vaiuedness 



Proof. We let 



Figure 4.1 



* = {+a, -a} X {+b, -b} X {A} X {B}, 



and define q as in Figure 4.2: 





+b 


— h 


+a 





1 
2 


a 


1 

2 






qi-r\A,B) 



Figure 4.2 



Now suppose, contra hypothesis, there is an equivalent hidden- variable model (r2,p) satisfying 
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Single- Valuedness and Outcome Independence. Let A = {A}. Then we must have 

1 



from which 



and 



p{+a,-b\A,B,X)^p{~a,+b\A,B,X) 2- 



p{ + a\A, B, A) = p{ + a,+b\A, B, X)+p{+a, "bl^, S, A) == + -, 
. , M R p{+a,-b\A,B,\) _\ _ 

PK-h\A,B,\) i 



contradicting Outcome Independence. ■ 

The conditions of EPR are tight. By Remark 3.1, we cannot drop Outcome Independence. By 
Theorem 3.1 or 3.2, we cannot drop Single- Valuedness. Here is a specific construction-for the EPR 
empirical model-of an equivalent hidden- variable model satisfying Strong Determinism (so, certainly 
Outcome Independence) and even A- Independence. Let A = {A^,A^}, and set p(A^) — p{X^) = \ 
and 

p(+a,-b|AS,Al) = l, 
p{-a,+b\A,B,\^)^l. 

Using p{A, B) ~ I, we see that the stated conditions hold. 

At the level presented here, the EPR argument doesn't need any quantum effects. It could be 
realized entirely classically. Von Neumann [;36] 1936] gave a nice example of classical action at a 
distance: 

Let 5*1 and 5*2 be two boxes. One knows that 1,000,000 years ago either a white ball 
had been put into each or a black ball had been placed into each but one does not know 
which color the balls were. Subsequently one of the boxes (5*1) was buried on Earth, 
the other (52) on Sirius .... Now one digs 5*1 on Earth out, opens it and sees: the ball 
is white. This action on Earth changes instantaneously the 6*2 statistic on Sirius .... 

In the QM context, EPR's conclusion was that the theory of QM needed to be "completed." 
This leads to the question of whether a construction like the one we just gave is always possible. 
This then leads to Bell's Theorem. 



17 



5 Bell 

Bell's Theorem adds crosses to Figure 4.1, as in Figure 5.1. 



Weak Determinism 



Outcome independence 



Parameter Independence 




LEGEND 

Possible 

jC Impossible 
GUARANTEED BY 



El Existence Theorem 1 
E2 Existence Theorem 2 
B Bell 

EPR ElnEtein-Podolsi<y-Rosen 

" y^Kochen-Specker 



^.-independence 



Singie-Vaiuedness 



Figure 5.1 

Once more, our formulation is in probability terms alone. In the Bell experiment, Ann (resp. Bob) 
can make measurements of spin on her (resp. his) entangled particle in three directions. For each 
measurement, the only possible outcome is positive or negative spin. If the measurements are 
made in the same direction, the results will be anti-correlated (Figure 5.2). Figure 5.3 gives 
the probabilities of the different outcomes of the measurements, when these are made in different 
directions. The probabilities in Figure 5.3 are essentially quantum-mechanical. 

Theorem 5.1 (Bell ^ 1964]) There is an empirical model (^,g) for which there is no equivalent 
hidden-variable model (ri,p) which satisfies X- Independence, Parameter Independence, and Outcome 
Independence. 

Another phrasing (using Proposition 2.1): There is no equivalent hidden- variable model which 
satisfies A-Independence and Locality. 

Proof. We let 

* = {+a, -a} X { + b, -b} X {Ai,A2,A3} X {^1,52,-83}, 

and define q as in Figures 5.2 and 5.3, with q{Ai, Bj) = | for all i,j. 
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+ 6 


-b 


+a 





1 
2 


~"a 


1 

2 






q{-,-\A„B,) 



Figure 5.2 





+b 


— b 








+a 


3 

8 


1 
8 


a 


1 

8 


3 

8 





q{-,-\A,,B^) for j ^i 



Figure 5.3 

Now suppose, contra hypothesis, there is an equivalent hidden- variable model (ri,p) satisfying 
A-Independence, Parameter Independence, and Outcome Independence. 

Fix an i. By assumption, p{Ai, Bi) > 0, since q{Ai, Bi) > 0. Using Figure 5.2, we have 

Q = q{+a,+b\A^,Bi)^ Y^ p{+a,+b\A„B,,X)p{\\A,,B,) = 

{A:p(A,,B,,A)>0} 

^ p(+„,+fc|A„B„A)p(A) = 

{A:p(A,,B,,A)>0} 

^ p(+a|A„A)p(+;,|B„A)p(A), 

{A:p(A.,S.,A)>0} 

where the second line uses A-Independence and the third line uses Parameter Independence, Outcome 
Independence, and Proposition 2.1. Using p{Ai,Bi) > and A-Independence again, we have 
p(A,,Bj,A) >0 if andonly ifp(A) > 0. Let M = {A : p(A) > 0}. Then, 



p{+a\A^,X) xp(+b|B„A)=0 



(5.1) 



whenever A G M. 
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A similar argument using q{—a, —b\Ai, Bi) = establishes 

p{-a\A,,\) xp(-b|B„A)=0 



(5.2) 



whenever A e M. 

Using (5.1) and (5.2), we see that for each «, there are disjoint sets Ki, Li C A, with KiULi = M, 

such that 

p{+a\Ai, A) = 1 and p{-b\Bi, A) = 1 when A e K^, 

p{-a\Bi, A) = 1 and p{+b\Bi, A) = 1 when A G L,. 



Similar to above, observe that 

g(+„,+t|A„Bj) == ^p(+„|^,,A)p(+fc|Bj-,A)p(A). 

M 

Using (5.3) (for i and j) in (5.4) we get 

q{+a,+b\A„Bj)=p{K,r]Lj). 
A parallel argument yields 



Now use Figure 5.3 to get 



whenever i ^ j- 



q{-a,-b\A^, Bj) = p{L, n Kj). 



p{K,r\Lj)+p{Lir\Kj) = 



1 y"""'^ 

1 ^ 


6 \ 


4 \s,,,__^ 


y^ 



M 



Figure 5.4 
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(5.3) 



(5.4) 



(5.5) 



Refer to Figure 5.4 (similar to figures in d'Espagnat [131 1979]), and let 

Li=gu0UgU0, 

L3 = ^u[6]u0Ug. 



Now (5.5) for {i,j) = (1,2), (2,3), and (3, 1) respectively, yields 

3 

4' 
3 
4' 
3 



p{KinL2)+p{LinK2) = -, 



p(if2ni3)+p(i2nX3) = J, 



piK3nLi)+piL3nKi) ^, 



p(0) +p(@) +p(0) +p(@) = ^, (5.6) 

p{\b\) + p{\&\) + p(0) + p(0) = ^, (5.7) 

p(@) +p(0) +p(0) +p(@) = ^. (5.8) 



Adding (5.6)-(5.8) gives 



2 X {p{\2\) +p{\i\)+p{\A\)+p{\^)+p{\Q\)+p{\^)) = ^, 
or 

p{\2\) +p{\^) +p{\a\) +p(0) +p(g+p(@) = ^, 

which is impossible. ■ 

Can we drop any of the conditions of Bell's Theorem? By Theorem 3.1, we cannot drop A- 
Independence. By Theorem 3.2, we cannot drop Parameter Independence. 

For the Bell empirical model, we also cannot drop Outcome Independence. To see this, let 
A = {A}. Then A-Independence is satisfied. Define p on \l/ x {A} from q on \E', as in Remark 3.1. 
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Wc then have 



p{+a\A,,B„ A) = q{+a\A,, B{) = -= q{+a\A,,Bj) = p{+a\A„Bj,\), 

p{+b\A„B„\) = q{+b\Ai,B,) = -=q{+b\Aj,B,)=p{+b\Aj,B,,\), 

so that Parameter Independence is satisfied. Of course, Outcome Independence fails, as it must. 
For example: 

p(+ahfc, A,, Bi,\)^l^ -^ p{ + a\A^, Bi, A). 

By contrast, the Kochen-Specker Theorem produces an impossibility even without Outcome 
Independence. 



6 Kochen-Specker 

The Kochen-Specker [211 1967] no-go result adds crosses to Figure 5.1, to give a complete picture as 
in Figure 1.1. 

At the physical level, the Kochen-Specker experiment differs from those in the past two sections 
in considering measurements on only one particle. There are many presentations of Kochen-Specker, 
of course. We follow Cabello, Estebaranz, and Garcia- Alcaine [HI 1996], a simple treatment which 
results in the 4x9 array of Table 6.1 (also presented in Held [^ 2000]). For various tuples of four 
orthogonal directions in 4-space (from a total of 18 directions), we ask whether or not the particle 
has spin in each of these directions. In each case, the answer will be that we get three directions 
without spin and only one direction with spin. 



A 


El 


El 


Es 


Es 


E2 


Eg 


E16 


Eie 


En 


B 


E2 


E5 


E9 


En 


E5 


En 


En 


Eis 


Eis 


C 


E3 


Eg 


E3 


Ej 


Ei3 


Eu 


E4 


Ee 


Ei3 


D 


Ei 


Ej 


Eio 


-£^12 


El4 


Ei5 


Eio 


E\2 


Ei5 



Table 6.1 



To state Kochen-Specker in our probabilistic framework, we will need to adapt the concept of 
exchangeability from probability theory (de Finetti [TTJ 1937], [12l 1972]). To give our definition, 
we consider the special case where the spaces of possible measurements are all the same, as are the 
spaces of possible outcomes: 



{A...} = {B,...} 



{Xi, X2, . . . , Xm}, 
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{a, ...} = {b, ...}=■■■ = {xi,X2,-.-,Xn}, 

for integers m, n. We will consider a permutation map n: 

(A,B,...)-W^),7r(i?),...), 
(a,5, ...) 1^ (7r(a),7r(6),...). 

Note that we use tt twice (despite the different domains), because we want to consider the same 
permutation on the two sequences. 

Definition 6.1 An empirical model (^,(?) satisfies Exchangeability if for any indices 11,12, • • ■ G 
{l,2,...,m} and ji,J2,... G {l,2,...,n}, 

q{A = Xi^,B^Xi^,...) >0 if and only if q{Tr{A) = X,^,tt{B) =Xi^,...)>Q, 

for any permutation it, and when both are non-zero, 



■12 1 ■ 



q{a = Xj^,b^ Xj^,...\A^ Xi^,B = X.,^ 

q{TT{a) = Xj^,Tr{b) = Xj^, . . .\tt{A) = Xi^,7T{B) = X^^,...). 

fn words, the requirement is that if we swap any number of measurements, then, as long as we 
swap the outcomes in the same way, the overall probability is unchanged. Thus, let q be the prob- 
ability that Ann gets the outcome Xj-^ and Bob gets the outcome Xj.-^ , if Ann performs measurement 
Xi-^ on her particle and Bob performs measurement Xi^ on his particle. Let q' be the probability 
that Ann gets the outcome Xj^ and Bob gets the outcome Xj-^ , if Ann performs measurement Xi^ on 
her particle and Bob performs measurement X^^ on his particle. Exchangeability says that q' = q. 
Likewise, for several measurements on a single particle. This is similar to exchangeability a la de 
Finetti, though with a conditioning component. 

Exchangeability might come from physical arguments. For example, the Bell model (Figures 5.2 
and 5.3) satisfies Exchangeability. (This reflects the underlying physical fact that only the angle 
between the two measurements matters.) 

Theorem 6.1 (Kochen-Specker |24[ 1967]) There is an empirical model (^,g) for which there 
is no equivalent hidden-variable model that satisfies \- Independence and Parameter Independence. 

Kochen-Specker demonstrated the existence of a QM model that fails Non-Contextuality: Whether 
or not their particle has spin in a certain direction is dependent on which other directions are also 
measured. The property of spin for such a particle does not stand alone. As the proof makes clear. 
Theorem 6.1 is really a corollary to their result. 
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Proof. Consider an empirical model where 

{A, . . .} = {S, . . .} - {C, . . .} = {D, ...} = {E,,E2, . . . , Eis}, 

{a,...}^{b,...}^{c,...}^{d,...} = {0,l}. 

Exchangeability is assumed to hold, and q assigns positive probability to each of the nine tuples of 
measurement settings. 

Finally, for any column, the empirical model has the property that precisely one of the following 
holds: 

g(l,0,0,0|^,,,S,,,S,3,S,J=.l, (6.1) 

q{0,l,0,0\E,,,E,,,E,„E,,) = 1, (6.2) 

g(0,0,l,0|^,,,S,,,^,3,S,J = l, (6.3) 

g(0,0,0,l|^,,,S,,,^,3,S,J = l. (6.4) 

Now suppose, contra hypothesis, that there is an equivalent hidden- variable model satisfying 
A-Independence and Parameter Independence. By Proposition 2.2, the above empirical model then 
satisfies Non-Contextuality. 

Next, take, say, the first column. If 

q{0,l,0,0\Ei,E2,E3,Ei) = l, (6.5) 

then certainly 

q{b=l\Ei,E2,E3,E4)^l. 

Since (_E2, £^5, -E13, -B14) is non-null, so is (i^s, i?2, -E13, £^14), by Exchangeabihty. Using Non- 
Contextuality, we therefore have 

q{b=l\E5,E2,Ei3,Eu) = l, 

from which, by Exchangeability again, 

q{a = l\E2,E5,Ei3,Eu) = l. 
Now use (6.1)-(6.4) to get 

g(l,0,0,0|£2,£5,£l3,£l4) = l, (6.6) 

which tells us about the fifth column. 

We therefore get a coloring problem: We try to color precisely one entry in each column- 
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corresponding to the measurement that yields a 1. For example, suppose we color the entry E2 in 
the first column-corresponding to (6.5). Then (6.6) tells us that we must color the entry £'2 in the 
fifth column. However, this is impossible. Each Ei appears an even number of times in Table 6.1, 
and there is an odd number of columns. Thus, the table cannot be colored. ■ 

7 Other No- Go Theorems 

There are many important papers on the no-go question not touched upon here. These include 
Fine [HI 1982], [H 1982], Greenberger, Home, and Zeilinger [201 1989], Malley and Fine [251 2005], 
Mermin [H 1990], [271 1993], Peres g9j 1990], [3S 1991], and Szabo and Fine [31 2002]. Again, 
our purpose is not to survey the literature. Rather, it is to give a complete picture of Figure 1.1 and 
all its 21 regions. As Figure 1.1 shows, just the three basic no-go theorems are needed for the six 
properties that we present. 

The absence of Gleason's Theorem ([THl 1957]) from our paper is a consequence of our choice 
not to impose any structure on our spaces (refer back to Footnote 4). In particular, we do not 
work in Hilbert space. Of course, Gleason's Theorem immediately implies the existence of the 
Kochen-Specker QM model (which we used in our Theorem 6.1). 

The recent no-go theorem of Conway and Kochen [TUl 2006] generalizes Kochen-Specker by 
relaxing Parameter Independence. Consider a two-particle system. The requirement is that, 
conditional on the value of the hidden variable, the outcome of any particular measurement Ann 
makes on her particle may depend (probabilistically) on the other measurements she makes but not 
on the measurements Bob makes on his particle. We could accommodate this result by adding a 
seventh property-a generalized parameter independence-to our six, but refrain from pursuing this 
extension here. 

Finally, we note the connection to Bohmian mechanics (Bohm [51 1952]). Diirr-Goldstein-Zanghi 
[151 2004, p. 993] explain: "In Bohmian mechanics the result obtained at one place at any given time 
will in fact depend upon the choice of measurement simultaneously performed at the other place." 
Indeed, Theorem 3.2 says that provided one is prepared to give up Parameter Independence, one 
can reproduce any empirical model-under A-Independence and Weak Determinism. Theorem 3.1 
says that if one is prepared to give up A-Independence, one can get even Strong Determinism. In 
a sense, then, these results 'predict' the possibility of Bohmian mechanics-though not its specific 
content, of course. 
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